@kolbykskk just wanted to raise the
# general-englisht
tejas
03/26/2025, 7:12 PM@kolbykskk just wanted to raise the issue you were seeing with @Nick K - CEO @ Trieve -- KB messages seem to be getting chunked up when getting sent to our assistant, it used to send as one large message and this is now polluting the transcript
n
Nick K - CEO @ Trieve
03/26/2025, 7:13 PMUnderstood
k
kolbykskk
03/26/2025, 8:29 PMYeah don't know if that's how Vapi attaches it into the LLM conversation or if you guys do it at Trieve
kolbykskk
03/26/2025, 8:31 PMHere's what I mean:
[
{
"role": "system",
"content": ""
},
{
"role": "user",
"content": "Here's some context from the knowledge base that you can use to answer the user's query if relevant: ..."
},
{
"role": "assistant",
"content": "Okay got it, I will use it only if needed."
},
{
"role": "user",
"content": "Here's some context from the knowledge base that you can use to answer the user's query if relevant: ..."
},
{
"role": "assistant",
"content": "Okay got it, I will use it only if needed."
},
{
"role": "user",
"content": "Here's some context from the knowledge base that you can use to answer the user's query if relevant: ..."
},
{
"role": "assistant",
"content": "Okay got it, I will use it only if needed."
},
{
"role": "user",
"content": "Here's my final query: Hello, what is a popular short style wig?"
}
]
kolbykskk
03/27/2025, 1:38 PM@Nick K - CEO @ Trieve could you just let me know if you guys insert these messages into the LLM conversation or if it’s Vapi? I assumed Vapi but if you can confirm
n
Nick K - CEO @ Trieve
03/27/2025, 2:09 PMWe do recommend doing it the way Vapi is. It's usually the best based on our evals.
k
kolbykskk
03/27/2025, 2:19 PMIdk 20 messages of kb context in the middle of the conversation makes the llm forget what it asked to begin with oftentimes
n
Nick K - CEO @ Trieve
03/27/2025, 2:19 PMTry lowering your topK
k
kolbykskk
03/27/2025, 2:20 PMI tried, it pulls 10 results no matter my topK
n
Nick K - CEO @ Trieve
03/27/2025, 2:21 PMAre you sure you are updating the correct knowledge base for this assistant?
Nick K - CEO @ Trieve
03/27/2025, 2:21 PMYou might want to look at the search analytics inside of Trieve
k
kolbykskk
03/27/2025, 2:28 PMYeah only have 1 kb but vapi isn’t sending the value into Trieve it looks like, might be their problem
n
Nick K - CEO @ Trieve
03/27/2025, 2:30 PMTry deleting and creating a new knowledge base. There might be an issue with updating KB's.
k
kolbykskk
03/27/2025, 6:41 PM@Shubham Bajaj
kolbykskk
03/27/2025, 6:59 PMHm created new KB in vapi and it's still not passing the topK value to Trieve. @Shubham Bajaj mentioned that I need to set the topK in Trieve not in Vapi, is that true?